DIAGRAMMATIC KAZHDAN-LUSZTIG THEORY FOR THE (WALLED) 

BRAUER ALGEBRA 



ANTON COX AND MAUD DE VISSCHER 

Abstract. We determine the decomposition numbers for the Brauer and walled Brauer 
algebra in characteristic zero in terms of certain polynomials associated to cap and curl 
diagrams (recovering a result of Martin in the Brauer case) . We consider a second family of 
polynomials associated to such diagrams, and use these to determine projective resolutions of 
the standard modules. We then relate these two families of polynomials to Kazhdan-Lusztig 
theory via the work of Lascoux-Schiitzenberger and Boe, inspired by work of Brundan and 
Stroppel in the cap diagram case. 



1. Introduction 

Classical Schur-Weyl duality relates the representations of the symmetric and general 
linear groups via their actions on tensor space. The Brauer algebra was introduced in [Bra37] 
to play the role of the symmetric group in a corresponding duality for the symplectic and 
orthogonal groups. Over the complex numbers it is generically semisimple [Bro55], indeed 
it can only be non-semisimple if 5 G Z [Wen88]. 

Building on work of Doran, Hanlon, and Wales [DWH99] we determined, with Martin, the 
blocks of the Brauer algebra over C [CDM09a] . This block structure could be defined in terms 
of the action of a Weyl group of type D [CDM09b], with a maximal parabolic subgroup of 
type A determining the dominant weights. The corresponding alcove geometry has associated 
translation functors which can be used to provide Morita equivalences between weights in 
the same facet [CDM11]. More recently, Martin [Mar] has shown that the decomposition 
numbers for the standard modules are given by the corresponding parabolic Kazhdan-Lusztig 
polynomials. 

The walled Brauer algebra was introduced in another generalisation of Schur-Weyl duality, 
by changing the tensor space on which the symmetric group acts. If instead a mixed tensor 
space (made of copies of the natural module and its dual) is considered, then the walled 
Brauer algebra plays the role of the symmetric group in the duality. This was introduced 
independently by a number of authors [Tur89, Koi89, BCH+94]. In [CDDM08] the walled 
Brauer algebra was analysed in the same spirit as in [CDM09a, CDM09b], and the blocks 
were again described in terms of the action of a Weyl group — but this time of type A, with 
a maximal parabolic subgroup of type A x A determining the dominant weights. 

The Kazhdan-Lusztig polynomials associated to (D n ,A n _i) and (A n ,A r _i x A n _ r ) are 
two of the infinite families associated with Hermitian symmetric spaces, and have already 
been considered by a number of authors. Lascoux and Schutzenberger [LS81] considered the 
(An, A r -i x A n - r ) case and gave an explicit formula for the coefficients in terms of certain 
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special valued graphs. This was extended to the other Hermitian symmetric pairs by Boc 
[Boe88]. A different combinatorial description was given by Enright and Shelton [ES87] in 
terms of an associated root system. (A more general situation has also been considered 
by Brenti [Bre09] who describes the corresponding polynomials in terms of shifted-Dyck 
partitions.) 

The Brauer and walled Brauer algebras are examples of diagram algebras. A quite different 
diagram algebra was introduced by Khovanov [KhoOO, Kho02] in his work on categorifying 
the Jones polynomial. Brundan and Stroppel have studied generalisations of these algebras, 
relating them to a parabolic category O and the general linear supergroup [BSa, BS10, BS11, 
BSb]. Along the way Kazhdan-Lusztig polynomials of type (A n ,A r ^i x A n _ r ) arise, and 
Brundan and Stroppel re-express the combinatorial formalism of Lascoux and Schiitzenberger 
in terms of certain cap diagrams. 

In this paper we will determine the decomposition numbers for the Brauer and walled 
Brauer algebras by analysing the blocks of these algebras in the (combinatorial) spirit of 
Brundan and Stroppel. For the Brauer algebra we introduce certain curl diagrams which 
correspond to the graph formalism in Boe, while the walled Brauer algebra involves only cap 
diagrams. The decomposition numbers for the Brauer algebra were determined by Martin 
[Mar]; our methods give a uniform proof that includes the walled Brauer case. 

One of the main organisational tools in our earlier work was the notion of a tower of 
recollement [CMPX06] . We give a slight extension of our earlier theory of translation functors 
for such towers [CDM11] and use this to reduce the decomposition number problem to a 
combinatorial exercise. This is then solved using curl diagrams, thus giving a unified proof 
for the Brauer and walled Brauer cases. 

In the Brauer case the combinatorial construction is related to that given in [Mar] . How- 
ever, using cap and curl diagrams we are able to explicitly calculate certain inverses to the 
decomposition matrices for both Brauer and walled Brauer. The polynomial entries of these 
matrices can be used to describe projective resolutions of the standard modules in each case. 
(Again, this is in the spirit of Brundan and Stroppel.) 

We begin in Section 2 with a brief review of the basics of Brauer and walled Brauer 
representation theory. Section 3 reviews (and slightly extends) the tower of recollement 
formalism, and the theory of translation functors in this context. Sections 4 and 5 introduce 
two of the main combinatorial constructions: oriented cap and curl diagrams. These are 
used in Section 6 to determine the decomposition numbers for our algebras. 

After providing a recursive formula for decomposition numbers in Section 7 we define a 
second family of polynomials using valued cap and curl diagrams in Section 8. These are used 
to determine projective resolutions of standard modules in Section 9. Finally, the relation 
between the polynomials associated to valued cap and curl diagrams and the construction 
of parabolic Kazhdan-Lusztig polynomials by Lascoux-Schiitzenberger and Boe is outlined 
in the Appendix. 

We would like to thank Paul Martin for several useful discussions. 
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2. The Brauer and walled Brauer algebras 

We will review some basic results about the representations of the Brauer and the walled 
Brauer algebra. The two theories are very similar; we will concentrate on the walled Brauer 
(which is less familiar) and sketch the modifications required for the classical Brauer algebra. 
Details can be found in [CDDM08] for the walled Brauer algebra, and in [CDM09a] otherwise. 
We will restrict attention to the case where the ground field is C, and assume that our defining 
parameter 5 is non-zero. 

Let n = r + s for some non-negative integers r, s. For 8 e C, the Brauer algebra B n (5) 
(which we will often denote just by B n ) can be defined in terms of a basis of diagrams. We 
will consider certain rectangles with n marked nodes on each of the northern and southern 
edges. Brauer diagrams are then those rectangles in which all nodes are connected to precisely 
one other by a line. Lines connecting nodes on the same edge are called arcs, while those 
connecting nodes on opposite edges are called propagating lines. Multiplication of diagrams 
A and B is by concatenation, to form a diagram C which may contain some number (t say) 
of closed loops. To form a diagram in our basis we set C equal to 5 t C where C is the 
diagram obtained from C by deleting all closed loops. 

Now decorate all Brauer diagrams in B n with a vertical wall separating the first r nodes 
on each edge from the final s nodes on each edge. The walled Brauer algebra B rjS (S) (or just 
B r>s ) is then the subalgebra of B n generated by those Brauer diagrams in which arcs cross 
the wall, while propagating lines do not. 

For 5 7^ let e T)S be <5 _1 times the diagram with all nodes connected vertically in pairs 
except for those adjacent to the wall, which are connected across the wall. This is an 
idempotent, and we have an algebra isomorphism 

Bj — l,s— 1 = &r,sBr,s&r,s- 

Via this isomorphism we have an exact localisation functor 

F r , s '■ B rs -mod — > S r _i jS _i -mod 

taking a module M to e rtS M, and a right exact globalisation functor G>_i iS _i in the opposite 
direction taking a module N to B r ^ s e T)S ®e r . s _B r , s e r , s N. There is a similar idempotent e n G B n 
and algebra isomorphism _B n _ 2 = e n B n e n , giving rising to corresponding localisation and 
globalisation functors F n and G n . 

Let S r denote the symmetric group on r symbols, and set £ riS = S r x E s . There is an 
isomorphism 

B r ^ s / B rs e. rs B rs = CS riS 

and this latter algebra has simple modules labelled by A r,s , the set of pairs of partitions of r 
and s respectively. By standard properties of localisation it follows that if r, s > then the 
set of simple modules for B r s is labelled by 

A rjS = A r ' s U A r _i jS _i. 

As B r fi = Bo r = S r we deduce that A rjS consists of all pairs A = (X L , X R ) such that X L is a 
partition of r — t and X R is a partition of s — t for some t > 0. We say that such a bipartition 
is of degree deg(A) = (r — t,s — t), and put a partial order on degrees by setting (a, b) < (c, d) 
if a < c and b < d. 
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Let A™ denote the set of partitions of n. Then by similar arguments we see that the 
labelling set A„ for simple P^-modules is given recursively by A n = A n U A n _2 and so A n 
consists of all partitions A of n — It for some t > 0. We say that such a partition is of degree 
deg(A) =n-2t. 

The e r _ t ,s-t with < t < min(r, s) induce a heredity chain in B r s , and so we can apply 
the theory of quasihereditary algebras. In particular for each A G A riS there is an associated 
standard module A rjS (A) with simple head L rjS (A) and projective cover P r)S (A). The standard 
modules have an explicit description in terms of walled Brauer diagrams and Specht modules 
for the various H r ^t,s~t, and determining the decomposition numbers for these modules in 
terms of their simple factors is equivalent to determining the simple modules themselves. 
In the same way the B n are quasihereditary, with standard modules A n (A), with simple 
modules L n (X), and projective covers P„(A). 

By general properties of our heredity chain we have 

G r>s A rtS (X) = A r+ i )S+ i(A) 

and 

A r _i jS _i(A) if A G A r _i iS _i 



FA m ~ J ^r-i,s-i(A) if A G A r _i 
r ' s rA ' ~ \ if A G A r ' s 



We define a partial order on the set of all partitions (or all bipartitions) by setting A < /i 
if deg(A) < deg(/i). This is the opposite of the partial order induced by the quasihereditary 
structure on A n or A r>s . Thus the decomposition multiplicity 

[A r>a (A) : L r>a (n)] 

is zero unless A < and is independent of (r, s) provided that A,/i G A rjS (and similarly for 
the Brauer case). 

As our algebra is quasihereditary each projective module P r , s (A) has a filtration by stan- 
dard modules. The multiplicity of a given standard A rjS (/i) in such a filtration is well-defined, 
and we denote it by 

D Xfl = (P r , s (A) : A r>s (/i)). 

By Brauer-Humphreys reciprocity we have 

D X)1 = [A rt8 (ji) : L r , s (A)] 

(and hence is independent of r and s). Again, analogous results hold for the Brauer 
algebra, and we shall denote the corresponding filtration multiplicities by also. 

The algebra B r ^ s can be identified with a subalgebra of P r +i iS (respectively of B rjS+ i) by 
inserting an extra propagating line immediately to the left (respectively to the right) of 
the wall. The corresponding restriction functors will be denoted res^ +l s and res^ s+1 , with 
associated induction functors ind^ s and ind^ s . Similarly, B n is a subalgebra of P n +i giving 
associated functors ind„ and res n+ i 

We will identify a partition with its associated Young diagram, and let add(A) (respectively 
rem(A)) denote the set of boxes which can be added singly to (respectively removed singly 
from) A such that the result is still a partition. Given such a box e, we denote the associated 
partition by A + e (respectively A — e). If we wish to emphasise that e lies in a given row (i 
say) then we may denote it by e^. 
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By [CDDM08, Theorem 3.3] we have 
Proposition 2.1. Suppose that A = (A L , \ R ) G A r -'> s ~*. If t = then 

res^ s A r , s (\ L ,\ R ) = A r _i iS (A L — e, X R ). 

lft>0 then there is a short exact sequence 
0^ A r _ M (A L -e,A fl ) ^res r L s A r , s (A) — ► A r _i jS (A L , A^ + e) — > 0. 

eGrem(A L ) e6add(A H ) 

There a similar result for res R s replacing rem(A L ) by rem(\ R ) and add(A' R ) by add(A L ). 
There is also a short exact sequence 

0^ A r , s+1 (A L -e,A R )^ind* A r , s (A)^ A riS+1 (A L , X R + e) > 

egrcm(A L ) eGadd(A fl ) 

where the first sum equals i/ X L = 0. Again there is a similar result for ind^ s . 

There is an entirely analogous result for the Brauer algebra, where the terms in the 
submodule of the restriction (or induction) of A n (A) are labelled by all partitions obtained 
by removing a box from A, and those in the quotient module by all partitions obtained by 
adding a box to A. For example, we have a short exact sequence 

0^ A n+1 (A-e) ^ind n A„(A) — > A n+1 (A + e)^0 

egrem(A) eSadd(A) 

where the first sum equals if A = 0. 

It will be convenient to consider the Brauer and walled Brauer cases simultaneously. In 
the walled Brauer case we will set (a) = (r, s), with (a — 1) = (r, s — 1) and (a+1) = (r+1, s). 
In the Brauer case we will set (a) = n with (a — 1) = n — 1 and (a + 1) = n + 1. Then A( a ) 
will denote either A r s or A n depending on the algebra being considered, and similarly for 
A( a )(A) and any other objects or functors with subscripts. 

3. Translation functors 

In [CDM11] we introduced the notion of translation functors for a tower of recollement, 
and showed how they could be used to generate Morita equivalence between different blocks. 
After a brief review of this, we will show how this can be applied to the Brauer and walled 
Brauer algebras. Details can be found in [CDM11, Section 4]. 

Let A n with n e N form a tower of recollement, with associated idempotents e n for 
n > 2. Let A n denote the set of labels for the simple A n modules, which we call weights. 
We denote the associated simple, standard, and projective modules by L n (X), A n (A) and 
P n (X) respectively. The algebra embedding arising from our tower structure give rise to 
induction and restriction functors ind n and res„. For each standard module A n (A), the 
module res n A n (A) has a filtration by standard modules with well-defined multiplicities; we 
denote by supp n (A) the multiset of labels for standard modules occurring in such a filtration. 
We impose a crude order on weights by setting A < \i if there exists n such that A G A n but 
ji A n . This is the opposite of the order induced by the quasihereditary structure. 
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In such a tower we have isomorphisms e n A n e n = A n _ 2 - Thus we also have associated lo- 
calisation functors F n and globalisation functors G n . Globalisation induces an embedding of 
A n inside A n+ 2, and an associated embedding of supp n (A) inside supp n+2 (A), which becomes 
an identification if A G A ra _2- We denote by supp(A) the set supp n (A) where n » 0. 

Let B n (X) denote the set of weights labelling simple modules in the same block for A n as 
L n (X). Again there is an induced embedding of B n (X) inside £>„ +2 (A), and we denote by B(X) 
the corresponding limit set. Given a weight A, we denote by pr^ the functor which projects 
onto the A„-block containing L n (X). We then define translation functors res^ = pr^resn 
and ind^ = pr^ +1 ind n . 

We say that two weights A and A' are translation equivalent if (i) we have 

B(X') n supp(A) = {A'} and B(X) n supp(A') = {A} 

and (ii) for all /i G B(X) there is a unique element // G B(X') fl supp(/i) and 

£(A)nsupp(//) = {//}. 

When A and A' are translation equivalent we denote by 9 : B(X) — > B(X') the bijection 
taking /i to //. 

By [CDM11, Propositions 4.1 and 4.2] we have 

Theorem 3.1. Suppose that A G A n and X' G A n _i are translation equivalent, and that 
fi G B n (X) is such that // G B n -i(X'). 

(i) We have 

res*' L n (n) = ind*_i = L n (n) 

and 

(ii) If t G B n (X) is such that r' G B n -i(X') then 

[AM : L n (r)] = [A^//) : L n _i(r')] 

and 

Hom(A„(/i), A n (r)) ^ Hom(A n _ 1 (/i / ), A n _i(r')). 
(raj //ii G z5 n _ 2 (A) i/ien 

res^P n (^)^P n _i(Ai')- 

The above result suggests that translation equivalent weights should be in Morita equiva- 
lent blocks, but this is not true in general as there will not be a bijection between the simple 
modules. However, by a suitable truncation of the algebra we do get Morita equivalences. 

The algebra A n decomposes as 

A n = P n (X) m ^ 

AeA n 

for some integers Let 1 = X^AeA e ™> A De ^ ne associated orthogonal idempotent decom- 

position of the identity in A n . There is also a decomposition of A n into its block subalgebras 

A n = Q)A n (X) 

A 
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where the sum runs over a set of block representatives. Now let T C B n (X) and consider the 
idempotent e n ,v = X] 7 gr e «,7- We define the algebra A nt r(X) by 

^n,r(A) = e n<r A( n (\)e nj r- 
By [CDM11, Theorem 4.5 and Corollary 4.7] we have 

Theorem 3.2. Suppose that X and A' are translation equivalent, with A G A n , and set 

T = 9(B n (\))CB n+1 (\'). 

(i) The algebras A n (X) and A„ + i 5 r(A') are Morita equivalent. In particular, if \B n (X)\ = 
|^n+i(A')| then A n (X) and A n+ i(X f ) are Morita equivalent. 

(ii) For all ji G B n (X) we have 

Ext i (A n (A), A n (//)) = Ext l (A n+1 (A'), A n+1 (//)). 

We will say that blocks B(X) and B(X') satisfying the condition in Theorem 3.2 are weakly 
Morita equivalent. 

The notion of translation equivalent weights is motivated by the translation principle in 
Lie theory, where translation functors give equivalences for weights inside the same facet. 
Another common situation in Lie theory involves the relationship between weights in a pair 
of alcoves separated by a wall. There is also an analogue of this in our setting. 

We say that A' separates A~ and A + if 

B(X') n supp(A-) = {A'} = B(X') n supp(A+) 

and 

B(X~) nsupp(A / ) = {A + ,A~}. 

Whenever we consider a pair of weights A~ and A + separated by A' we shall always assume 
that A" < A+. By [CDM11, Theorem 4.8] we have 

Theorem 3.3. (i) If X' G A n _i separates X~ and X + then 

res^' £„(A + ) = L n _i(A'). 

(ii) If further we have Hom(A n (A + ), A n (A - )) ^ then 

res^' L n (X~) — 

and ind^_ x A„(A') is a nonsplit extension of A„(A~) by A„(A + ) and has simple head L n (X + ). 

Suppose that A' and A + are weights with A' < A + such that for every weight r' G B(X') 
either (i) there is a unique weight r + G B(X + ) fl supp(r') and r' is the unique weight in 
B(X') nsupp(r + ), or (ii) there exists r~, r + G B(X + ) such that r' separates r _ and r + . Then 
we say that A' is in the lower closure of A + . If every pair of weights and fi + in B(X + ) 
separated by some // G B(X') satisfy the condition in Theorem 3.3(h) then we say that B(X + ) 
has enough local homomorphisms with respect to B(X'). 

We will need one new general result about translation functors for towers of recollement 
not included in [CDM11]. 
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Proposition 3.4. Suppose that £>(A + ) has enough local homomorphisms with respect to 
B(X'). If X' is in the lower closure of \ + then 

indf P n (A') = Pn+i(A+). 

If further X' G A n _ 2 then 

resf P n (A') = P t -i(A+). 

Proof. The module ind^ + P n (X') is clearly projective, as induction (and taking a direct sum- 
mand) takes projectives to projectives. 

Suppose that r G B(X + ) and that 

res^' +1 L„ +1 (r) ^ 0. 

By our assumptions and Theorems 3.1 and 3.3 this implies that r G supp(//) for some 
// G B(X') and r = From this we see that if 

Hom n+1 (ind* + P n (X') , L n+1 (r)) = Hom n (P n (A'), res^' +1 L n+1 (r)) 

is non-zero then r = fi + for some fi' G -B(A'). But 

Hom„(P„(A'),res^' +1 L„ +1 ( / u + )) = Hom n (P n (A'), pr*' £(//)) = 5av 

by Theorems 3.1 and 3.3. Thus ind^ + P n (A') has simple head L n+1 (A + ), and hence is equal 
to P n+ i(A + ) as required. 

Now suppose that further A' G A n _ 2 . By [CDM11, Lemma 4.3] we have 

C„-2pi-2(A') = P n (A'). 

By the tower of recollement axioms we have 

ind^ 2 M = res^ + G„_ 2 M 

for any A n _ 2 -module M and hence 

resf P n (A') = resf G n _ 2 P n _ 2 (A') = ind^ 2 P n _ 2 (A') = P„_!(A + ) 

using the first part of the Proposition. □ 

Remark 3.5. It was shown in [CDM09a] that the Brauer algebras form a tower of recolle- 
ment. Similarly, in [CDDM08, Sections 2-3] it was shown that the walled Brauer algebras 
form a tower of recollement by using alternately the functors res L (and ind L ) and res R (and 
ind^). The existence of enough local homomorphisms was shown for the Brauer algebra in 
[DWH99, Theorem 3.4] and for the walled Brauer algebra in [CDDM08, Theorem 6.2]. Thus 
we can apply the results of this section to these algebras. 

When using the notation ind^ s for the walled Brauer algebra, the choice of ind^ s or ind^ s 
will be such that the weight A makes sense for the resulting algebra (and similarly for res^J. 

Remark 3.6. There are reflection geometries controlling the block structure of the Brauer 
[CDM09b] and walled Brauer algebras [CDDM08] which we will review shortly. These define 
a system of facets, and in [CDM09b] it was shown that two weights in the same facet 
for the Brauer algebra have weakly Morita equivalent blocks in the sense of Theorem 3.2. 
This required certain generalised induction and restriction functors for the non-alcove cases. 
Similar functors can be defined for the walled Brauer algebras: it is a routine but lengthy 
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exercise to verify that the construction in [CDM11, Section 5] can be extended to the walled 
Brauer case. Thus we also have weak Morita equivalences between weights in the same facet 
in the walled Brauer case. 

4. Oriented cap diagrams 

In this section we will describe the construction of oriented cap diagrams associated to 
certain pairs of weights for the walled Brauer algebra. These diagrams were introduced by 
Brundan and Stroppel in [BSa] to study Khovanov's diagram algebra. We will see later 
that they give precisely the combinatoric required to describe decomposition numbers for 
the walled Brauer algebra. 

Let {ti : % G Z, % ^ 0} be a set of formal symbols, and set 

x= n Ze - 

iei\{0} 

For x G X we write 

X — (. . . , X_3, X_2, X-\\ X±, X2, X3, . . .) 

where Xi is the coefficient of We define A + C X by 

A + = {x G X : • • • > rr_ 3 > x_ 2 > > x 2 > x 3 > ■ ■ ■} 

and for 5 G Z we define 

p = Ps = (--- ,3,2,l;5,5-l,5-2 r --)eA + . 

Given a bipartition A = (A L , X R ) with X L = (Af , . . . , A^) and X R = (Af , . . . , Af ), we define 
A G X by 

A = (. . . , 0, 0, — A^, — A^_ 1 , . . . , — Af ; Af , . . . , Af , 0, 0, . . .). 
Given such a bipartition A we define 

x\ = x\, P = \ + ps- 

Note that x x G A + . In this way we can embed the sets A r s labelling simple modules for 
B rtS (5) as subsets of A + . 

Consider the group W of all permutations of finitely many elements from the set Z\{0} 
(so W = : i,j G Z\{0}) where (ij) is the usual notation for transposition of a pair % 

and j). This group acts on X by place permutations. 

The main result (Corollary 10.3) in [CDDM08] describes the blocks of B r . :S (5) in terms of 
orbits of certain finite reflection groups inside W. However it is easy to see from the proof 
that the following version also holds. 

Theorem 4.1. Two simple modules L r>s (A) and L r ^ s (p) are in the same block if and only if 
x\ = wx^ for some w G W . 

We will abuse terminology and say that x\ and x^ are in the same block if they satisfy 
the conditions of this theorem. 
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To each element x e A + we wish to associate a diagram with vertices indexed by Z, each 
labelled with one of the symbols o, x, A, V. We do this in the following manner. Given 
x G A + define 

Iy(x) = {xi : i < 0} and I A (x) = {xi : i > 0}. 
Now vertex n in the diagram associated to x is labelled by 

o if n £ Iv(x) U I A (x) 

x if n e Iv(x) n I A (x) , - 

V if ne I v (x)\I A (x) [ ) 

A if n e I A (x)\I v (x). 

Example 4.2. To illustrate the above construction, consider the bipartition A = (X L ,X R ) 
where X L = (2, 2, 1) and \ R = (3, 2), and take 5 = 2. Then 

Pi = (..., 4, 3, 2,1; 2, 1,0, -1,-2,...) 



and 

and hence 



A = (..., 0,-1, -2, -2; 3, 2, 0,0,0,...) 



xx = X + Ps = (...,6, 5, 4, 2, 0,-1; 5, 3, 0,-1, -2, -3...). 
Part of the associated diagram is illustrated in Figure 1. 

/x /x /x X X Q x/ /x N/ X N/ N/ N/ — 

-4 -3 -2 -1 1 2 3 4 5 6 7 8 

Figure 1. The diagram associated to ((2, 2, 1), (3, 2)) with 5 = 2. 

Note that any element in A + is uniquely determined by its diagram, and every such 
diagram corresponds to an element in A + . For this reason we will use the notation x (or x\) 
for both. 

Remark 4.3. It is easy to see that two elements in A + are in the same W-orbit if and only 
if they are obtained from each other by permuting pairwise a finite number of As and Vs. 

We define a partial order < on A + by setting x < y if y is obtained from x by swapping 
a V and a A so that the A moves to the right, and extending by transitivity. Note that if 
A, n e A TyS then x\ < x^ if and only if A and /i are in the same block and X < p (where this 
is the natural order on bipartitions from Section 2). Therefore we use the same symbol for 
both orders. 

Example 4.4. There is only one element in A + smaller than the element X\ in Example 
4.2. This corresponds to the diagram in Figure 2. 

/x /x /x X X Q /x N/ N/ X N/ N/ N/ — 

-4 -3 -2 -1 1 2 3 4 5 6 7 8 



Figure 2. The unique diagram smaller than the diagram in Figure 1. 
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Remark 4.5. For a bipartition A = (\ L ,\ R ), the diagram for the element x\ G A + is 
labelled by A for all n « and by V for all n » 0. Thus there are only finitely many 

x < X\. 

To each bipartition A (or to each diagram labelled by A for all n « and by V for all 
n » 0) we associate a cap diagram c\ in the following (recursive) manner. 

In x\ find a pair of vertices labelled V and A in order from left to right that are neighbours 
in the sense that there are only os, xs, or vertices already joined by caps at an earlier stage 
between them. Join this pair of vertices together with a cap. Repeat this process until there 
are no more such V A pairs. (This will occur after a finite number of steps.) Finally, draw 
an infinite ray upwards at all remaining As and Vs. Any vertices which are not connected 
to a ray or a cap are called free vertices. 

Example 4.6. In Figures 3 and 4 we give two examples of elements x\ and their associated 
cap diagrams. 



/\ /\ /\ 



xx xx 



7V 



XX 



-e 



7X" 



■e 



sz XX 




Figure 3. An example of the cap diagram construction. 



/\ /\ /\ 



XX XX 



7X XX 



N/ N/ X Q /x Q N/ X /x N/ x/ x/ N/ 




Figure 4. Another example of the cap diagram construction. 

To a cap diagram c and an element X\ G A + we can associate a labelled cap diagram cx\ 
by writing each label on a vertex of x\ underneath the corresponding vertex of c. We call 
such a diagram an oriented cap diagram if the following conditions all hold: 

(1) each free vertex in c is labelled by a o or x in x\] 

(2) the vertices at the end of each cap in c are labelled by exactly one A and one V in 

(3) each vertex at the bottom of a ray in c is labelled by a A or V in xa; 

(4) it is impossible to find two rays in c whose vertices are labelled V and A in order 
from left to right in x\. 
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As each cap in an oriented cap diagram is labelled by exactly one A and one V, these 
symbols induce an orientation on the cap (as though they were arrows). The degree deg(ca;A) 
of an oriented cap diagram cx\ is the total number of clockwise caps that it contains. 

Remark 4.7. Given a bipartition A, the labelled cap diagram c\X\ is clearly oriented, with 
all caps having a counterclockwise orientation. Thus the degree of c\X\ is 0. 

For two bipartitions A and /i we define d\^(q) to be q de &( c * x n) if (i) A and \x are in the same 
W^-orbit, and (ii) c x x^ is an oriented cap diagram. We define d Xfl (q) to be otherwise. In 
other words, d\^{q) ^ if and only if x^ is obtained from x\ by swapping the order of the 
elements in some of the pairs V, A which are joined up in c\, and in that case deg^x^) is 
the number of pairs whose elements have been swapped. 

Example 4.8. Let x\ and c\ be as in Figure 3. For x^ as illustrated in Figure 5 we see that 
c\x^ is an oriented cap diagram with deg(c\x^) = 3. Hence we have that 



/x /x /x X X /x /x N/ N/ X Q /x X/ xx X N/ N/ /\ Q X/ X/ 



/X ZX /X 



X X ^ x/ >< Q /y\ X V N Ox Q x l / x l / 



Figure 5. An example of a nontrivial degree calculation. 



Remark 4.9. Brundan and Stroppel have shown how to associate weights in a set similar 
to A + to cap diagrams and oriented cap diagrams in order to use this combinatoric to 
describe the representation theory to the general linear supergroup GL(m\n) [BSb]. Note 
the difference between these two sets, and the difference between the assignments of labels 
in [BSb, (1.6)] and in (1). 

We are interested in determining the decomposition numbers for the walled Brauer alge- 
bras. As noted in Section 2 this is equivalent to determining the 

D\fi = (P r>a (A) : KM)- 

Our eventual aim is to show 

Theorem 4.10. Given A and /x in A rjS we have 



We will first introduce a corresponding formalism for the Brauer algebra, so that the two 
cases can be considered simultaneously. 
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5. Oriented curl diagrams 

We will introduce analogues of oriented cap diagrams for use in the ordinary Brauer algebra 
case. As the two cases will ultimately be very similar, we use the same notation. Which case 
is being considered later will be clear from context. 

Let {ti : i E N} be a set of formal symbols, and set 

*=(n z «.)u(n( z +^y 

VieN / VieN / 

For iGlwe write 

x = (x 1 ,x 2 , . . •) 

where Xi is the coefficient of ej. We define A + C X by 

A + = {x G X : x\ > x 2 > ■ ■ ■ } 

and for 5 G Z define 

/ 5 5 5 5 . , 

P =p J = (- 5 ,- 3 -l,-j-2,---3,...)€^. 

Given a partition A we define 

xx = A + pa G A + . 

Consider the group 

^=((i,j),(i,i)_:i^jeN> 

where (r/) is the usual notation for transposition of a pair i and j, and is the element 

which transposes i and j and also changes their signs. Then W acts naturally on X, with 
acting as place permutations, and 

(u) — ("^l ' j • • • , Xj, . . . , Xj, . . .) (xi, X2, • • • , Xj , . . . , Xj, . . .) . 

The main result in [CDM09b] describes the blocks of B n (5) in terms of certain finite 
reflection groups inside W. Just as in the walled Brauer case, it is easy to see that the 
following version holds. Here we denote the transpose of a partition A by A T . 

Theorem 5.1. Two simple modules L n (\ T ) and L n (/x T ) are in the same block if and only if 
x\ = wx^ for some w G W . 

To each x G X we wish to associate a diagram. This will have vertices indexed by NU {0} 
if x G riieN^ 6 * or by N - | if x G ELeN^ + |) e *- Each vertex will be labelled with one of 
the symbols o, x, V, A, or O. Given x G A + define 

J A (x) = {xj : Xj > 0} and Iv(x) = {xj : Xj < 0}. 

We also set Io(x) = {xj : Xj = 0}, so Io(x) can consist of at most one element. Now vertex 
n in the diagram associated to x is labelled by 

o if n £ Iv(x) U ^a(^) 

x if n G Iv(x) H I A (x) 

< V if n G 7 v (a:)\/ A (a;) (2) 

A if n G I A (x)\Iv(x) 

O if n G Io (x). 
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Note that every element in A + is uniquely determined by its diagram, and every such 
diagram corresponds to an element in A + (provided that is labelled by o or O). For this 
reason we will use the notation x (or x\) for both. 

Example 5.2. Let A = (4, 3, 2) and 5 = 1. Then we have 



and 



ps { 2 , 2 , 2 >--->; 

.73179 
x x = X + p 5 = (-,-,--,--,--,...,). 



The corresponding diagram is shown in Figure 6. 

N / /x Q X N/ N/ N/ N/ N/ 

1/2 3/2 5/2 7/2 9/2 11/2 13/2 15/2 17/2 - 

Figure 6. The diagram associated to A = (4, 3, 2) when 5=1. 

Remark 5.3. It is easy to see that two elements in A + are in the same FF-orbit if and only 
if they are obtained from each other by repeatedly swapping a V and a A or replacing two Vs 
by two As, where O can also play the role of either V or A. If we fix a A where x\ contains O 
then we can arbitrarily choose to replace this O by either V or A, and this defines a unique 
choice of V or A for every other element of the same block. Thus in what follows we will 
always assume that a fixed choice of V or A has been made for the symbol O for some weight 
in each block. Our combinatorial constructions will not be affected by this choice (provided 
we are consistent in a given block). 

We define a partial order < on A + by setting x < y if y is obtained from x by swapping 
a V and a A so that the A moves to the right, or if y contains a pair of As instead of 
a corresponding pair of Vs in x, and extending by transitivity. Note that for partitions 
G A n we have x\ < x M if and only if A and ji are in the same block and A < fj, (where 
this is the natural order on partitions from Section 2). Thus we use the same symbol for 
both partial orders. 

Remark 5.4. For a fixed partition A the diagram for x\ is labelled by V for all n » 0. 
Thus there are only finitely many x < X\. 

To each X\ e A + we now associate a curl diagram c\ in the following (recursive) fashion. 

In x\ find a pair of vertices labelled V and A in order from left to right that are neighbours 
in the sense that there are only os, xs, or vertices already joined by caps at an earlier stage 
between them. Join this pair of vertices together with a cap. Repeat this process until there 
are no more such V A pairs. (This will occur after a finite number of steps.) 

Ignoring all os, xs and vertices on a cap, we are left with a sequence of a finite number 
of As followed by an infinite number of Vs. Starting from the leftmost A, join each A to the 
next from the left which has not yet been used, via a clockwise arc around all vertices to the 
left of the starting vertex and without crossing any other arcs or caps. If there is a free A 
remaining at the end of this procedure, draw an infinite ray up from this vertex, and draw 
infinite rays from each of the remaining Vs. We will refer to the arcs connecting As as curls. 
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Example 5.5. An example of this construction is given in Figure 7. 




\/ \/ \/ 



Figure 7. An example of the curl diagram construction. 

To a curl diagram c and an element X\ G A + we can associate a labelled curl diagram cx\ 
by writing each label on a vertex of x\ underneath the corresponding vertex of c. We call 
such a diagram an oriented curl diagram if the following conditions all hold: 

(1) each free vertex in c is labelled by a o or x in xy, 

(2) the vertices at the end of each cap in c are labelled by exactly one A and one V in 

(3) the vertices at the end of each curl in c are labelled by two As or two Vs in x\\ 

(4) each vertex at the bottom of a ray in c is labelled by a A or V in x\\ 

(5) it is impossible to find two rays in c whose vertices are labelled V and A, or A and 
A, in order from left to right in x\. 

Each cap or curl in an oriented curl diagram has an orientation induced by the terminal 
symbols (as though they were arrows). The degree deg(cxA) of an oriented curl diagram cx\ 
is the number of clockwise caps and curls that it contains. 

Remark 5.6. Given a partition A, all caps and curls in the labelled curl diagram C\X\ are 
clearly oriented anticlockwise. Thus the degree of c\X\ is 0. 

For two partitions A and /i we define d\^(q) to be q de s( c * x n) if (i) A and /i are in the same 
W-orbit, and (ii) c\x^ is an oriented curl diagram. We define d\^{q) to be otherwise. 

Example 5.7. Let x x and c A be as in Figure 7. For x^ as illustrated in Figure 8 we see that 
c\x^ is an oriented curl diagram with deg(cAa^) = 2. Hence we have that 

<W?) = q 2 - 

We are interested in determining the decomposition numbers for the Brauer algebras (and 
hence recovering the result of Martin [Mar]). As noted in Section 2 this is equivalent to 
determining the 

= (P n (A) : AM). 

Our eventual aim is to show 

Theorem 5.8. Given A and \i in A n we have 
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X Q x/ X 



"7V 



"TV 



\/ \/ \/ 




Figure 8. An example of the calculation of the degree of a curl diagram. 

6. Decomposition numbers from oriented cap and curl diagrams 

The aim of this section is to prove Theorems 4.10 and 5.8. To do this we will apply the 
translation functor formalism from Section 3. We will consider the two cases simultaneously 
as they are very similar. 

Fix A G A r s or A n . We will proceed by induction on the partial order < introduced in 
Section 4 or 5. If x\ is minimal in its block with respect to the order < then we have 

for all fi and so we are done. 

Suppose that x\ is not minimal in its block. We proceed by induction on |A|. (Note that 
if A L = or \ R = then x\ = p is minimal.) Then x\C\ contains at least one cap or curl. 

First consider the cap case: we may choose the cap so that it does not contain any smaller 
caps (and hence all vertices inside the cap are labelled by x or o only). We call such a cap 
a small cap. There are three cases, which are illustrated in Figure 9. Note that we will 
henceforth abuse notation and write A instead of x\. 




Figure 9. The three possible small cap configurations 

Case (i): The vertex at the point marked with a A is of the form Xi for some i G Z\{0}, 
and (in the walled Brauer case) by the definition of A we must have i > 0. Now consider 
A' = (A', X R — e,j) or A' = A — e^. Note that Xi — 1 is not an entry in x\ and hence A' is a 
(bi)partition. The diagram associated to A' is illustrated on the right-hand side of Figure 
9(i). 

We claim that A and A' are translation equivalent; that is for every /i G B(\) there exists 
a unique // G B(\') flsupp(/i) and for every /i' G B(\') there is a unique /i G £>(A) fl supp(//). 
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Indeed, it is easy to see that the only places where x M and ay can differ are at the vertices 
labelled Xi and Xi — 1, and the possible cases are illustrated in Figure 10. 



n e^— v- 

n' 7V ^_ n' 

Figure 10. The possible diagrams for x M and ay in case (i) 



Recall our labelling convention involving (a) from Section 2. By Theorem 3.1 and the 
inductive hypothesis we have that 

D\n = [A ((l) (/i) : L (a) (A)] 

= [A (a _ 1) ( A x'):^(a-i)(A , )] = J DAV = dAv( 1 )- W 

But if we ignore the xs and os (which play no role other than as place markers in the 
definition of d\^) then the cap or curl diagrams c\ and c x > are identical, and hence 

d x ,^(l) = d^(l). (4) 

Combining (3) and (4) we see that = dx^l) as required. 

Case (ii): This is very similar to case (i). The vertex at the point marked with a x is in 
the walled Brauer case of the form x_j for some j G Z\{0}, and by the definition of x we 
can take j > 0. In the Brauer case this vertex is of the form xt > and xi and — X; t both 
appear in x\, and we choose j so that x j — —X{. 

Now consider A' = (A L — tj,X R ) or A' = A — €j. (As before it is easy to verify that A' 
is a (bi)partition.) The diagram associated to A' is illustrated on the right-hand side of 
Figure 9 (ii) . As in case (i) the weights A and A' are translation equivalent, where the various 
possibilities for x M and X u/ clS before are shown in Figure 11. 



V- V- 

H' H' 

Figure 1 1 . The possible diagrams for x M and x^ in case (ii) 



The rest of the argument proceeds exactly as in case (i). 

Case (iii): The vertex at the point marked with a A is of the form Xi for some % G Z\{0}, 
and (in the walled Brauer case) by the definition of A we must have % > 0. Now consider 
A' = (A L , \ R — €i) or A' = A — 6j (which as before is a (bi)partition), and set A + = A. Note 
that there is another element A~ G B(\ + ) fl supp(A'); the three diagrams associated to A + , 
A' and A~ are illustrated in Figure 9 (iii) . 

Moreover, for each // G B(X') there are exactly two elements fi + and in B(X) nsupp(//') 
(which correspond to the same three configurations as for A + , A~, and A' at the two points 
Xi and Xi — 1). Also, // is the unique element in B(X') fl supp( / u ± ). Thus A' is in the lower 
closure of A + . 
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For fx G B(X) we have 

D XfM = [A (a) (/i):L (a) (A)] 

= dimHom(P (a) (A+),A (a) (/i)) 

= dimHom(ind( l a _ 1) P (a _i)(A'), A (a) (/i)) 

= dimHom(P (a _ 1) (A / ),res^ ) A (a) (/i)) 

where the third equality follows from Proposition 3.4. Now res^ A( )(//) 7^ implies that 
/x = y u ± with fj! G B(X') fl supp(/i ± ) and so Pa^ = unless /x = /i ± G £>(A) fl supp(//). Note 
that for any 11 not of this form in £>(A) the two vertices labelled x,i and Xj — 1 must be either 
both As or both Vs, which implies that = 0. 

If n = /i ± as above then 

D Xfl ± = dimHom(P (a _i)(A / ), A (a _i)(/i')) = P>av = d AV (l) 

by the induction hypothesis. Finally, note that Cyx^i is an oriented cap diagram if and only 
if c\x^± is an oriented cap diagram, and so 

D XfJ ,± = d Xlx ±(l) 

as required. 

This completes the proof for the walled Brauer algebra. However, for the Brauer algebra 
the diagram c x may contain only curls. We pick the one involving the left-most A, and there 
are five cases, which are illustrated in Figure 12. 




Figure 12. The five possible small curl configurations 

Cases (iv-vii): These are very similar to cases (i) and (ii) above. In each case A' is obtained 
from A by swapping the leftmost or right-most end of the curl with the symbol immediately 
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to its left (either o or x). Arguing exactly as in cases (i) and (ii) we see that A and A' are 
translation equivalent, and satisfy 

<W?) = d X ',M'(q). 

Thus the result follows by induction. 

Case (viii): We are left with the case where the curl is labelled with (a) \ and §, or (b) 
and 1. 

First consider configuration (a), with | in the ith entry of X\. As — \ is not in x\ we 
have that A' = A — ej is a partition. The corresponding diagrams are illustrated in Figure 
12 (viii) (a). These two elements are translation equivalent, and the result follows as in case 
«• 

Finally consider configuration (b), and suppose that is in the ith entry of x\. As —1 is 
not in x\, we have that A' = A — tj is a partition. Setting A + = A we see by arguing as in 
case (iii) that A' is in the lower closure of A + (with A - as illustrated in Figure 12 (viii) (b)). 
The result for this case follows just as in case (iii). 

Remark 6.1. We have shown that 

for both the Brauer and walled Brauer algebras. In the Brauer case Martin [Mar] has 
introduced a similar diagram calculus, but omitting the labels marked with x or o and using 
caps instead of curls. This allowed him to define versions of the dx^iq) and determine the 
decomposition numbers. 

However, the dx^q) encode more than just their values at q — 1, and we would like to have 
a representation-theoretic interpretation of these as polynomials in q. Instead we shall define 
some closely related polynomials px^{q) and show how these can be related to projective 
resolutions for our algebras. The definition of this second family of polynomials crucially 
depends on the distinction between caps and curls in our construction of curl diagrams. 

Before defining our second family of polynomials, we consider the relation of the dx^(q) to 
certain Kazhdan-Lusztig polynomials. 

7. A RECURSIVE FORMULA FOR DECOMPOSITION NUMBERS 

We will show how the polynomials dx^iq) can be calculated recursively. The Brauer 
and walled Brauer cases will be considered simultaneously. We will then relate this to the 
conjectured recursive formula for the Brauer algebra given in [CDM11] (and proved in [Mar]). 

Proposition 7.1. (i) Let A' G supp(A) be as in one of the cases in Figure 9 or 12, with A 
and A' translation equivalent. Then 

d\'v'(q) = dxM)- 

(ii) Suppose that A contains a small cap as in Figure 9 (iii), or a small curl as in Figure 
12 (viii) with in x X - Denote A by A + and let A' and \~ be as indicated in the corresponding 
Figure. Then 

d\+^+(q) = dx'n'iq) 
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Also we have 
and 
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dx+^-iq) = qd X 'n'(q)- 
d\+^+(q) = q^dx-^+iq) + d x - fX -(q) 
d\+»-(q) = qdx-^-iq) + d x - )l +(q). 



(5) 
(6) 



Proof. Everything is obvious by construction except for (5) and (6). There are seven cases, 
which are illustrated in the cap case in Figure 13 and in the curl case in Figure 14. 



X~ 
X~ 
X~ 
X~ 




Figure 13. Four small cap configurations 




Figure 14. Three small curl configurations 

All of the cases are very similar, so we will consider just the case in Figure 13 (i). The 
weights A + and A~ are illustrated in Figure 15 together with the two possible configurations 
(a) and (b) for /i + and fx~ in the same block as A + and A - at the four marked vertices. (The 
elements ji and // must agree at all of the vertices not indicated in the diagram.) 

If fj, + is as in configuration (a) then we have 

dx+^-(q) = qdx+^+(q) 

dx-/x-(q) = d x +^+(q) 

dx-n+(q) = o 

which implies (5) and (6) as required. 
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Figure 15. The first cap case 

If n + is as in configuration (b) then we have 

d\+^-(q) = qdx+ft+iq) 

d\-n-(q) = o 

d\-^+{q) = qd x +^+(q) 
which implies (5) and (6) as required. Similar arguments hold in the remaining cases. □ 

Suppose that A is a regular weight, i.e. there are no vertices labelled x in its diagram. 
This corresponds to A lying in an alcove in the language of [CDDM08] and [CDM09b]. In 
[CDM11] we reviewed the recursive formula for parabolic Kazhdan-Lusztig polynomials of 
type (D, A) following [Soe97] and conjectured that this gave the decomposition numbers for 
the Brauer algebra. This algorithm is in two stages, corresponding to translating the original 
polynomial and then subtracting lower order terms. This conjecture was proved by Martin 
in [Mar]. Exactly the same construction and conjecture can be made for the walled Brauer 
case, involving parabolic Kazhdan-Lusztig polynomials of type (A, A x A). 

Corollary 7.2. The decomposition numbers for the Brauer and walled Brauer algebras in 
the case of regular blocks can be calculated (as parabolic Kazhdan-Lusztig polynomials) as in 
[CDM11]. 

Proof. It follows from (5) and (6) that the recursive formula corresponding to translating a 
parabolic Kazhdan-Lusztig polynomial holds for the d\^. By definition, the dx^ are mono- 
mials in q with strictly positive degree if A ^ /j, and dx^iq) ^ 0. This implies that there is 
no subtraction of lower order terms in the calculation of parabolic Kazhdan-Lusztig polyno- 
mials, and hence the dx^{q) are indeed parabolic Kazhdan-Lusztig polynomials. □ 

Remark 7.3. There are a number of related constructions of (parabolic) Kazhdan-Lusztig 
polynomials (see [Soe97, Section 3] for the relationship between them). In [LS81] and [Boe88] 
closed forms are given for certain Kazhdan-Lusztig polynomials arising from types (D, A) 
and (A, A x A) (among others); in Section 8 we will recover these from our diagrams by 
defining new polynomials px^(q)- The relation between the p x ^(q) and the dx^q) will be 
given in Corollary 9.2. 

8. Valued cap and curl diagrams 

In this section we will return to the combinatorics of cap and curl diagrams, and define 
a new family of polynomials associated to pairs of (bi)partitions A and ji. These are given 
by a diagrammatic version of the combinatorial formulas for Kazhdan-Lusztig polynomials 
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given in [LS81] and [Boe88]; a discussion of the relation between the two approaches can be 
found in Appendix A. 

Fix A G A r s or A n and /i G B = B(X). We set 1(B) to be the infinite set of non-zero 
integers indexing the vertices of x\ labelled by V or A, but excluding the leftmost one. Set 
I(\, ji) to be the finite subset of 1(B) indexing vertices that are labelled differently in x\ and 
in x^. For i G 1(B) define 

/j(A,/i) = #{j G /(A,/i) : j >i and vertex j of x\ is labelled by A} 

— #{j G /(A,/i) : j >i and vertex j of is labelled by A}. 

Note that A > fi if and only if ^(A, //) > for all % G 1(B). We set 

«e/(B) 

Any cap or curl diagram cuts the upper half plane into various open connected regions, 
which we will call chambers. Recall that we say that a cap or curl in c is small if it does not 
contain any cap or curl inside it. Given a pair of chambers separated by a cap or curl, we 
say that they are adjacent and refer to the one lying below as the inside chamber, and the 
other as the outside chamber. The vertices labelled with V or A will be called the non-trivial 
vertices. 

In the curl diagram case we may have a chamber A (possibly unbounded) inside which 
there are a series of maximal chambers (i.e. chambers adjacent to A) Ai, . . ., A t from left 
to right not separated by the end of a curl. If A 1 is formed either by a curl or by a cap 
involving the leftmost non-trivial vertex then we say that Ai, . . . , A t forms a chain. 

A valued cap diagram c is a cap diagram whose chambers have been assigned values from 
the integers such that 

(1) all external (unbounded) chambers have value 0; 

(2) given two adjacent chambers, the value of the inside chamber is at least as large as 
the value of the outer chamber. 

A valued curl diagram c is a curl diagram whose chambers have been assigned values from 
the integers such that (1) and (2) above hold and also 

(3) the value of the chamber defined by a cap or curl connected to or containing inside 
itself the leftmost non-trivial vertex must be even; 

(4) if Ai, . . . A t is a chain and the value of Ai is less than or equal to that of Aj for all 
1 < j < i then the value of Ai must be even. 

Given a valued cap/curl diagram c, we write |c| for the sum of the values of c. 

We are now able to define a new polynomial p\^(q) associated to our pair A and fi in B. 
If x\ ^ x M then set p\^(q) = 0. Otherwise, let D(\, /i) be the set of all valued cap/curl 
diagrams obtained by assigning values to the chambers of c M in such a way that the value of 
every small cap or curl is at most k(X,fj,), where % indexes the right-most vertex of the cap 
or curl. Now set 

P M = g lM E <T 2|C| 

ceD(\,fi) 
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and write p^ for the coefficient of q m in p\^(q). That P\^{q) is indeed a polynomial will 
follow from Proposition 8.2, and hence 

m>0 

Example 8.1. In Figure 16 we have illustrated a pair of diagrams x\ and together with 
the curl diagram c M and the value of /j(A,/z) for each vertex % in our diagram. Thus in this 

case 

= 2 + 3 + 2 + 2 + 1 + 1 = 11. 

The various allowable values for the chambers in the curl diagram are indicated in the Figure, 
where only the chambers marked a and b can be non-zero. We must have a G {0,2} and 
b e {0,1, 2}. 

Now the valued cap diagram is in D(X, /i) if and only if 

(a, b) E {(0,0), (0,1), (0,2), (2,0), (2, 2)}. 

For example, note that we cannot have (a, b) = (2, 1) as this configuration would not satisfy 
condition (4). Thus we see that 

PxM) = <? H (1 + Q~ 2 + 2<T 4 + q~ 8 ) = q 11 + q 9 + 2q 7 + g 3 . 




L^ii) 2 3 22101 00000 

X ^ /x N/ X Q /x X /x /x ,x N/ /x X /x /x X/ N/ N/ 

FIGURE 16. An example of the calculation of P\^(q)- 

Pick a small cap or curl in A. The possible configurations of caps in A are given in Figure 
9(i-iii) and of curls in Figure 12(iv-viii). Associated weights A' are shown in each case, 
with two subcases appearing in Figure 12(viii), together with weights A~ in Figure 9(iii) 
and Figure 12(viii)(b). We will show how the values of px^q) can be calculated from the 
polynomials py^/ and p\- T for suitable choices of r, which will give a recursive formula for 
the p v . 

Consider the configurations shown in Figure 9(iii) and Figure 12(viii)(b). In both of these 
cases we will denote A by A + , and then the weights A + and A~ are separated by A' and A' is 
in the lower closure of A + . We will say that an element is of the form fi + if it is in the same 
block as A + and has the same configuration of As and Vs as A + at the vertices on the small 
cap or curl under consideration. 
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Proposition 8.2. (i) Let X and X' be one of the configurations in Figure 9 (%-%%) or Figure 
12(iv-vii), or as in Figure 12(viii)(a) where the vertices on the small curl are labelled \ and 
§. Then 

for all ii G B(X). 

(ii) Let X and A' be configured as in Figure 9 (Hi) or as in Figure 12(viii)(b) where the vertices 
on the small curl are labelled and 1. Then setting A + = A we have 

Px+ij,+ (q) = Pav (q) + qP\-»+ (<?) (7) 

and 

p\+M) = qpx-^(q) ( 8 ) 

for all /i not of the form 

Proof. (Compare with [Boe88, (3.14) Proposition].) In the cases in Figure 9(i-ii) and Figure 
12(iv-vii) the weights A and A' are translation equivalent. By construction we have in all of 
these cases that 

P\M) =P\'»>(q) 

for all pi G B(X). The case in Figure 12(viii)(a) occurs when the vertices on the small 
curl are labelled \ and |, and again the weights A and A' are translation equivalent. The 
translation equivalence is given by changing the ±| entry in to =f| in ay. Therefore 
/j(A,/i) = li(X',fj,') for all i G 1(B) and all other caps and curls are preserved. Thus in this 
case we also have that 

P\M) =P\'p'(q) 

for all G B(X). 

The two remaining cases are those shown in Figure 9(iii) and Figure 12(viii)(b). In both 
of these cases the weights A + and A~ are separated by A' and A' is in the lower closure of 
A + . We first consider (7). We claim there is a one-to-one correspondence between D(X + , fi + ) 
and D(X',fj,') U _D(A~,/i + ). Let i be the rightmost vertex of the small cap or curl under 
consideration in x\. It is easy to see that 

k(X + ,fi + ) =/,(A-,/i + ) + l 

and that if % — 1 is the left-most non-trivial vertex then /j(A + ,/i + ) is even. 

The valued cap/curl diagrams in D(X + ,fi + ) split into two subsets, those where the value 
of the small cap/curl under consideration is less than Zj(A + ;/ u + ) and those where the value 
is equal to /j(A + ,/i + ). The first set are exactly the valued cup/curl diagrams in D(X~,fi + ). 

We will show that the second set is obtained from the set of valued cap/curl diagrams 
D(X', fi') by adding to each element a cap/curl joining vertices %—\ and % with value /j(A + , fi + ). 
For c G D(X',fi') denote by c + the corresponding valued cap/curl diagram with this extra 
cap/curl. We need to show that c + is indeed in D(X + ,/i + ) to give the desired bijection. 

We check that inserting this extra cap/curl with the given value satisfies the condition 
(1-4) in the definition of a valued cap/curl diagram. (1) is obvious. 

For (2), suppose that our small cap/curl is nested inside a larger one d. We may assume 
that they are adjacent. There are three possible cases, illustrated in Figure 17. Suppose 
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Figure 17. The possible nested cases 

that there is a small cap in the dotted region in Figure 17; if we pick the leftmost such cap 
and j denotes its right-hand vertex then it is easy to see that 

/,(A + ,/i + ) </,(A + ,/i + ). 

So the value of this small cap is at most Zj(A + )y u + ) and hence the value of d is at most 

If the dotted region in Figure 17 is empty then let j be the vertex at the right-hand end 
of the cap/curl defining d. If this is a cap then we have 

^(A+,/x + )</ l (A + ,/i + ) 

and so the value of d is at most Zj(A + ./x + ). If we have a small cap or curl nested in a curl 
then 

But d has to be even and k(\ + ,fj, + ) is even, and so the value of d is at most /j(A + ,/i + ). 

For (3), as noted above if % — 1 is the leftmost non-trivial vertex then /j(A + ,/i + ) is even. 

Finally for (4), suppose we have a chain of chambers. If our small cap/curl is the leftmost 
in the chain then denote the vertices of the next chamber along in the chain as shown in 
Figure 18. By the same argument as in (2) we see that d has value at most /j(A + ,/i + ), and 
as k was the leftmost non-trivial vertex we have that d is even. 




Figure 18. The leftmost chain cases 



If there is a chamber to each side of our small cap in the chain then we are in the config- 
uration shown in Figure 19. As before the value of e is at most /j(A + ,/z + ). If e has value at 
most that of d and all other predecessors then removing the small cap at % we have a chain 
in D(X',fj,') and so d is even as required. 
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Figure 19. The mid-chain cases 

If our small cap is the rightmost in the chain then a similar argument shows that the 
preceding chamber d in the chain has value at most /,(A + ,/i + ) < /j(A + ,/x + ). If /j(A + ,/z + ) is 
no greater than all preceding values in the chain then li(X + ,fi + ) is at most the value of d, 
and hence by the preceding inequality the value of d equals /j(A + ,/x + ). Removing our small 
cap gives a chain in D(A', //) and hence /j(A + ,/i + ) must be even. Thus conditions (1-4) are 
satisfied and hence c + e D(\ + ,fi + ) as required. 

It is also clear that 

l(\ + ,^)=l(\~,V + ) + l 

and 

Z(A+, /U + ) = Z(AV) + 2/ l (A+, / x+). 

Hence 

ceD(A+, M +) 

= g «(A+,M+) ^ q~ m + g'( A+ >'* + ) ^ g~ 2|c+l 
c£D(\-,v+) ceD(\',(i') 

= q.q l{x ~>^ +) Y <T 2|C ' + q l ^''^ +2l ^ x+ '^ ^ g -2| c |-2« l (A+, M +) 
ceD(\-^+) ceD(\',fi') 

It remains to show that (8) holds. If fi is not of the form /i + then it must have a different 
configuration of Vs and As on the pair of vertices defined by our small cap or curl. Thus the 
possible configurations are as indicated in Figure 20, where the top row (a-c) corresponds to 
the small cap case in Figure 9(iii) and the bottom row (d-f) corresponds to the small curl 
case in Figure 12(viii)(b). 

(a) \/ \/ (b) /v /v (c) /x \/ 

(d) \/n/ (e) n/ yK (f) ^ n/ 

FIGURE 20. The possible configurations of /i not of the form /i + 
In all six cases we have 

/(A + ,/i) = /(A-,/i) + l. 

Let % be the rightmost of the vertices on the small cap/curl in A. Note that for all j ^ i we 
have that 

l j (\ + ,fi) = l j ( y \',fi) and li(\ + ,fi) = k(X~,fj) + 1. 
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Now for /j, as in Figure 20(a), (c), (d), or (f) there is no cap/curl in c M with rightmost 
vertex i, and so in these cases we have that 

D(\ + , f i)=D(\-, f i). 

For \i as in Figure 20(b) or (e) there might be a cap/curl with rightmost vertex i. 

If i is the second non-trivial vertex in \i (or A + , A~), then k(\~, /i) is even and so /j(A + , /z) 
is odd. Also the cap/curl in \x involved the first non-trivial vertex in ji and so its value must 
be even. Hence we again have that 



Figure 21. The final configuration of /i 

If % is not the second non-trivial vertex then we must have a configuration of the form in 
Figure 21. Note that 

/ l - 2 (A + ,/i) < h(X + , fi) - 1 = k(\- , fi) 
and as the values are non-increasing in nested chambers we again have that 

D(\+,fi) = D(\~,fi). 



Thus in all cases we have 



px + M = ^ (A+,M) E ^ 2|c| 

ceD(\+,n) 



= QQ 



i(\-,n) 



E 



-2\c\ 



□ 



9. Projective resolutions of standard modules 

We now have the combinatorial framework needed to describe projective resolutions of 
standard modules for the walled Brauer algebra. This is inspired by the corresponding 
result for Khovanov's diagram algebra in [BS10, Theorem 5.3] 

Theorem 9.1. For each A G A riS there is an exact sequence 

► P^W — ► ► PfaW — > P (a)W ^ A W( A ) ^ 

where 
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Proof. Let A G A( ). If A is minimal then 

A (a) (A)=P (a) (A) = P ( ° a) (A) 

and P^(A) = for all m > and for all (a) with A G A( a ). Thus we may assume that A is 
not minimal. 

As in Section 6 we choose a cap or a curl in A not containing any smaller caps or curls. 
We have eight cases to consider as shown in Figures 9 and 12. We proceed by induction on 
deg(A). Note that in all cases we have deg(A') < deg(A) and in cases (iii) and (viii)(b) we 
also have deg(A~) < deg(A). So we can assume that the result holds for A' and A - . 

In cases (i), (ii), (iv-vii) and (viii)(a) we have by induction a projective resolution of 
A( 0+1 )(A') of the form 

► ^d(a') — ► ► P(UuM — ► p^dM — ► A (a+ i ) (A / ) — ► o. 

In these cases we saw that A and A' are translation equivalent. Applying the exact functor 
res (a+i) ^° ^ ms res °hition and using Theorem 3.1 (iii) and Proposition 8.2(i) and (ii) we get 
a projective resolution 

► Jft(A) — ► > (A) — ► P ( ° a) (A) — ► A (a) (A) — ► 

as required. 

For the cases (iii) and (viii)(b) we set A + = A. By induction we have projective resolutions 
of A( a+1 )(A') and A( a )(A~) of the form 

► ^i)(A ; ) — ► > Pl +1) (A') — ► P ( ° a+ i)(A') — ► A (a+1) (A') — ► (9) 

and 

> ^)(A-) — ► ► Pi)(A-) — ► P ( a) (A") — ► A {a) (A") — ► 0. (10) 

We also have an exact sequence 

— ► A (a) (A-) -A res? a+1) A (a+1) (A') — ► A (a) (A + ) — ► 0. 

Applying res* a+1 ) to (9) and extending / to a chain map using (10) we get a commutative 
diagram with exact rows 

^(a)(A-) ► P ( ° a) (A-) A (a) (A") ->0 

I 11/ 

r < +1) P ( - +1) (A') ► resf a+1) P ( ° a+1) (A) resJ a+1) A (a+1) (A) ^0 

which we extend into a double complex by adding 0s in all remaining rows. 
Taking the total complex of this double complex gives an exact sequence 

► Jft(A-) © resf a+1) P^A') — h • • • 

► A (a) (A-)©resf a+1) P ( ° a+1) (A / ) ^ resj a+1) A (a+1) (A') — ► 0. (11) 

By Proposition 2.1 there is an obvious injective chain map from 

y — ► > ^ A (o) (A") — ► A (a) (A-) — ► 
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to the complex in (11), and the quotient gives an exact sequence 

► Jft(A-) © resj a+1) P^A') — ► ► resf a+1) P ( ° a+1) (A') — ► A (a) (A+) — ► 0. 

(12) 

By Propositions 3.4 and 8.2(iii) we have 

resf a+1) P ( ° a+ i)(A') = resj a+1) P (a+1) (A') = P (a) (A+) = P ( ° a) (A+). 
For m > we have by Proposition 3.4 and Proposition 8.2 that 

^)(A-)©resf a+1) P™+ 1 1 ) (A')= ©pf'/wM® © res? a+1) P (a+1) (//) 

tieB(x) ju'eB(A') 

= © pJ^mM© © P^-jOO 
mgB(a) fi'eB(X') 

= © © p^wm 

M+e£(A) MeB(A),^+ 

= © pKi )p w(^ + )® © pK 1 ^) 

M+GB(A) jzeB(A),/^+ 

= © pK 1)p w^) = p w +1) ( A+ ) = p w fl) ( A )- 

mgb(a) 

Substituting into (12) we obtain the desired projective resolution of A( a )(A). □ 

For fixed (a) we can consider the matrices formed by the p\^(q) and the dx^q) with rows 
and columns indexed respectively by A and fi in A( a ). The next pair of Corollaries follow 
from the last Proposition in exactly the same way as in [BS10, Corollaries 5.4 and 5.5]. 

Corollary 9.2. The matrix (pxfi(-q)) is the inverse of the matrix (dxfj,(q)). 
Corollary 9.3. We have 

PxM) = ^2 qi dimExt*(A(A), L(fj)). 

Remark 9.4. We have seen that the walled Brauer algebras have the same combinatoric for 
decomposition numbers and for projective resolutions of standard modules as the generalised 
Khovanov diagram algebras studied by Brundan and Stroppel [BSa, BS10, BS11, BSb]. They 
have shown that these Khovanov algebras are Morita equivalent (in a limiting sense) to blocks 
of the general linear supergroup, and that their quasihereditary covers are Morita equivalent 
to certain parabolic category Os. It would be very interesting (if true) to determine an 
analogous relationship between these algebras and the walled Brauer algebra, and to find 
analogous correspondences for the Brauer algebra. 

Appendix A. Kazhdan-Lusztig polynomials 

In this section we shall review the constructions of Kazhdan-Lusztig polynomials corre- 
sponding to A r x A s inside A r+s+ \ and A n ^i inside D n given respectively by Lascoux and 
Schutzenberger [LS81] and by Boe [Boe88], and how these can be identified (up to a power 
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of q) with the polynomials associated to valued cap diagrams and valued curl diagrams. In 
the former case this was already observed in [BS10]. 

We begin by outlining the construction of Boe [Boe88]. Fixing W of type D n and a fixed 
subCoxeter system of type A n _i defines a dominant set of elements in W . These can be 
identified with words of the form 

w — w n . . . Wi 

where each Wi G {a, f3}, such that the number of as is even. Because of this parity condition 
the final element W\ is redundant and is omitted. 

Given a partition A we will identify the weight x\ with a word w of the above form in the 
following manner. Fix m » so that m is the rightmost vertex in x\ lying on a cap or curl 
in c\, and let n be the number of vertices labelled V or A between and m inclusive, and we 
associate A to the word w obtained by setting Wi = a (respectively 0) if the (n — i)th such 
vertex from the left is V (respectively A). We will refer to these vertices as the non-trivial 
vertices in x\. 

Note that the identification letters in w read from left to right correspond to vertices in 
x\ read from right to left. 

Lascoux-Schiitzenberger introduced the cyclic monoid Z in the letters a and f3 [LS81, 
Section 4]. Rather than repeating their definition, we note that if w — w'zw" with z G Z 
then z corresponds to a line segment in x\ where the non-trivial vertices form a sequence 
of (possibly nested) caps. If w — w'az(3w" then Boe calls a and (3 a linked af3 pair; this 
corresponds to a cap in our terminology. If 

W = W ' aZ2 r OLZ2r~\OL . . . az\azo 

with Zi G Z then Boe calls the rightmost a terminal and each pair of as separated by some 
zn a linked aa pair. Under our correspondence linked aa pairs correspond to curls. As Boe 
omits w\ but x\ retains the corresponding point, a terminal a corresponds to either a cap 
or a curl involving the leftmost non-trivial vertex. 

Boe next defines a rooted directed tree associated to the word w. It is routine to verify 
that this corresponds to the tree with vertices labelled by the chambers for x\, where an edge 
connects chamber A to chamber B if chamber A is adjacent to and surrounds chamber B, 
and the unbounded chambers (separated by infinite rays) are regarded as a single unbounded 
chamber via the point at infinity. 

Thus the root of the tree corresponds to the unique unbounded chamber, while the terminal 
nodes correspond to the small chambers. Certain edges in the tree are marked with a plus 
sign; these correspond to edges which cross either a curl or a cap involving the left-most 
non-trivial vertex. 

Certain pairs of edges in the tree are related by a dotted arrow. We will describe the 
diagram version; the equivalence of the two is a straightforward exercise. Suppose we have 
a chamber A (possibly unbounded) inside which there are a series of maximal chambers 
Ai, . . . , At from left to right (possibly containing other chambers inside them) not separated 
by the end of a curl. If the leftmost chamber A\ is formed either by a curl or by a cap 
involving the leftmost non-trivial vertex, then there is a dotted arrow from the edge defined 
by A,i in A to the edge defined by A i+1 in A for 1 < % < t — 1. 
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In fact the dotted arrows are redundant in the diagram case: the leftmost chamber in a 
curl must always be formed either by a curl or by a cap involving the left-most non-trivial 
vertex, and the same is true in any unbounded chamber with no ray to its left. Chambers 
formed by caps or with a ray to their left cannot contain curls or the left-most non-trivial 
vertex. Thus we can omit the dotted arrows in our diagrams without any ambiguity. 

Instead of labelling edges with plus signs, we will label chambers by moving any labels to 
the vertices at the bottom of their respective edges. 

Example A.l. An example of the correspondence between curl diagrams and labelled 
graphs is given in Figure 22. Here we have included the dotted arrows to emphasise where 
they occur. Note that the graph must be reflected in the vertical axis under the correspon- 
dence with the construction for Boe in terms of words in a and j3. 




Figure 22. The diagram graph correspondence 

Remark A. 2. Our construction appears to depend on the choice of m defined by the right- 
most vertex on a cap or curl. However, Boe's construction (in our diagrammatic form) is 
not affected by the addition of arbitrarily many rays to the right. Thus we can carry out all 
calculations involving our diagrams in the unbounded setting. 

Boe next associates to pairs of words (w,y) a labelling of the tree for w. Under our 
identifications this corresponds to a valued curl diagram. The polynomial Q y , w {q) defined 
by Boe by summing over possible labellings corresponds almost exactly to our px^q). More 
precisely, if we denote by w(X) and u>(/i) the words in a and j3 corresponding to A and /i (as 
described at the beginning of this section), then we have that 

We have considered the relation between Boe's rooted tree construction and curl diagrams. 
There is an entirely analogous relation between the rooted tree construction of Lascoux- 
Schutzenberger and cap diagrams. In that case there are no linked aa pairs or terminal 
as marked with a plus sign, and thus no chambers contain chains. The remainder of the 
construction goes through unchanged. 
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